Papers by Yakup Abrek Er
Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing Turkish benchmarks lack task diversity or culturally relevant content . Cetvel combines a broad range of discriminative and generative tasks . |
| Approach: | They propose a benchmark to evaluate large language models in Turkish . Cetvel combines a broad range of discriminative and generative tasks . they find that Turkish-centric instruction-tuned models generally underperform . |
| Outcome: | The proposed benchmark covers 23 tasks grouped into seven categories . it shows that Turkish-centric instruction-tuned models underperform relative to multilingual or general-purpose models despite being tailored for the language. |